SgmlV1, France, Analysis, bibRecord, 000046

Overview of the CLEF 2004 Multilingual Question Answering Track

Identifieur interne : 000046 ( France/Analysis ); précédent : 000045; suivant : 000047

Overview of the CLEF 2004 Multilingual Question Answering Track

Auteurs : Bernardo Magnini [Italie] ; Alessandro Vallin [Italie] ; Christelle Ayache [France] ; Gregor Erbach [Allemagne] ; Anselmo Pe As [Espagne] ; Maarten De Rijke [Pays-Bas] ; Paulo Rocha [Portugal] ; Kiril Simov [Bulgarie] ; Richard Sutcliffe [Irlande (pays)]

Source :

Lecture Notes in Computer Science [ 0302-9743 ]

RBID : ISTEX:3F44C2770B28CC57C00AACF6B8084C8E14D25809

Abstract

Abstract: Following the pilot Question Answering Track at CLEF 2003, a new evaluation exercise for multilingual QA systems took place in 2004. This paper reports on the novelties introduced in the new campaign and on participants’ results. Almost all the cross-language combinations between nine source languages and seven target languages were exploited to set up more than fifty different tasks, both monolingual and bilingual. New types of questions (How- questions and definition questions) were given as input to the participating systems, while just one exact answer per question was allowed as output. The evaluation exercise has highlighted some difficulties in assessing definition questions and can be improved in the future, but the overall analysis of submissions shows encouraging results.

Url:

https://api.istex.fr/ark:/67375/HCB-3RJ1PXH5-4/fulltext.pdf

DOI: 10.1007/11519645_38

Affiliations:

Links toward previous steps (curation, corpus...)

to stream Istex, to step Corpus: 001038
to stream Istex, to step Curation: 000C94
to stream Istex, to step Checkpoint: 000715
to stream Main, to step Merge: 000786
to stream Main, to step Curation: 000779
to stream Main, to step Exploration: 000779
to stream France, to step Extraction: 000046

Links to Exploration step

ISTEX:3F44C2770B28CC57C00AACF6B8084C8E14D25809

Le document en format XML

<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Overview of the CLEF 2004 Multilingual Question Answering Track</title>
<author><name sortKey="Magnini, Bernardo" sort="Magnini, Bernardo" uniqKey="Magnini B" first="Bernardo" last="Magnini">Bernardo Magnini</name>
</author>
<author><name sortKey="Vallin, Alessandro" sort="Vallin, Alessandro" uniqKey="Vallin A" first="Alessandro" last="Vallin">Alessandro Vallin</name>
</author>
<author><name sortKey="Ayache, Christelle" sort="Ayache, Christelle" uniqKey="Ayache C" first="Christelle" last="Ayache">Christelle Ayache</name>
</author>
<author><name sortKey="Erbach, Gregor" sort="Erbach, Gregor" uniqKey="Erbach G" first="Gregor" last="Erbach">Gregor Erbach</name>
</author>
<author><name sortKey="Pe As, Anselmo" sort="Pe As, Anselmo" uniqKey="Pe As A" first="Anselmo" last="Pe As">Anselmo Pe As</name>
</author>
<author><name sortKey="De Rijke, Maarten" sort="De Rijke, Maarten" uniqKey="De Rijke M" first="Maarten" last="De Rijke">Maarten De Rijke</name>
</author>
<author><name sortKey="Rocha, Paulo" sort="Rocha, Paulo" uniqKey="Rocha P" first="Paulo" last="Rocha">Paulo Rocha</name>
</author>
<author><name sortKey="Simov, Kiril" sort="Simov, Kiril" uniqKey="Simov K" first="Kiril" last="Simov">Kiril Simov</name>
</author>
<author><name sortKey="Sutcliffe, Richard" sort="Sutcliffe, Richard" uniqKey="Sutcliffe R" first="Richard" last="Sutcliffe">Richard Sutcliffe</name>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">ISTEX</idno>
<idno type="RBID">ISTEX:3F44C2770B28CC57C00AACF6B8084C8E14D25809</idno>
<date when="2005" year="2005">2005</date>
<idno type="doi">10.1007/11519645_38</idno>
<idno type="url">https://api.istex.fr/ark:/67375/HCB-3RJ1PXH5-4/fulltext.pdf</idno>
<idno type="wicri:Area/Istex/Corpus">001038</idno>
<idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Corpus" wicri:corpus="ISTEX">001038</idno>
<idno type="wicri:Area/Istex/Curation">000C94</idno>
<idno type="wicri:Area/Istex/Checkpoint">000715</idno>
<idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Checkpoint">000715</idno>
<idno type="wicri:doubleKey">0302-9743:2005:Magnini B:overview:of:the</idno>
<idno type="wicri:Area/Main/Merge">000786</idno>
<idno type="wicri:Area/Main/Curation">000779</idno>
<idno type="wicri:Area/Main/Exploration">000779</idno>
<idno type="wicri:Area/France/Extraction">000046</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Overview of the CLEF 2004 Multilingual Question Answering Track</title>
<author><name sortKey="Magnini, Bernardo" sort="Magnini, Bernardo" uniqKey="Magnini B" first="Bernardo" last="Magnini">Bernardo Magnini</name>
<affiliation wicri:level="1"><country xml:lang="fr">Italie</country>
<wicri:regionArea>ITC-Irst, Trento</wicri:regionArea>
<wicri:noRegion>Trento</wicri:noRegion>
</affiliation>
<affiliation wicri:level="1"><country wicri:rule="url">Italie</country>
</affiliation>
</author>
<author><name sortKey="Vallin, Alessandro" sort="Vallin, Alessandro" uniqKey="Vallin A" first="Alessandro" last="Vallin">Alessandro Vallin</name>
<affiliation wicri:level="1"><country xml:lang="fr">Italie</country>
<wicri:regionArea>ITC-Irst, Trento</wicri:regionArea>
<wicri:noRegion>Trento</wicri:noRegion>
</affiliation>
<affiliation wicri:level="1"><country wicri:rule="url">Italie</country>
</affiliation>
</author>
<author><name sortKey="Ayache, Christelle" sort="Ayache, Christelle" uniqKey="Ayache C" first="Christelle" last="Ayache">Christelle Ayache</name>
<affiliation wicri:level="3"><country xml:lang="fr">France</country>
<wicri:regionArea>ELDA/ELRA, Paris</wicri:regionArea>
<placeName><region type="region">Île-de-France</region>
<region type="old region">Île-de-France</region>
<settlement type="city">Paris</settlement>
</placeName>
</affiliation>
<affiliation wicri:level="1"><country wicri:rule="url">France</country>
</affiliation>
</author>
<author><name sortKey="Erbach, Gregor" sort="Erbach, Gregor" uniqKey="Erbach G" first="Gregor" last="Erbach">Gregor Erbach</name>
<affiliation wicri:level="3"><country xml:lang="fr">Allemagne</country>
<wicri:regionArea>DFKI, Saarbrücken</wicri:regionArea>
<placeName><region type="land" nuts="2">Sarre (Land)</region>
<settlement type="city">Sarrebruck</settlement>
</placeName>
</affiliation>
<affiliation wicri:level="1"><country wicri:rule="url">Allemagne</country>
</affiliation>
</author>
<author><name sortKey="Pe As, Anselmo" sort="Pe As, Anselmo" uniqKey="Pe As A" first="Anselmo" last="Pe As">Anselmo Pe As</name>
<affiliation wicri:level="3"><country xml:lang="fr">Espagne</country>
<wicri:regionArea>Departamento de Lenguajes y Sistemas Informáticos, UNED, Madrid</wicri:regionArea>
<placeName><settlement type="city">Madrid</settlement>
<region nuts="2" type="region">Communauté de Madrid</region>
</placeName>
</affiliation>
<affiliation wicri:level="1"><country wicri:rule="url">Espagne</country>
</affiliation>
</author>
<author><name sortKey="De Rijke, Maarten" sort="De Rijke, Maarten" uniqKey="De Rijke M" first="Maarten" last="De Rijke">Maarten De Rijke</name>
<affiliation wicri:level="4"><country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Informatics Institute, University of Amsterdam</wicri:regionArea>
<placeName><settlement type="city">Amsterdam</settlement>
<region>Hollande-Septentrionale</region>
</placeName>
<orgName type="university">Université d'Amsterdam</orgName>
</affiliation>
<affiliation wicri:level="1"><country wicri:rule="url">Pays-Bas</country>
</affiliation>
</author>
<author><name sortKey="Rocha, Paulo" sort="Rocha, Paulo" uniqKey="Rocha P" first="Paulo" last="Rocha">Paulo Rocha</name>
<affiliation wicri:level="1"><country xml:lang="fr">Portugal</country>
<wicri:regionArea>Linguateca, Braga Node, Universidade do Minho</wicri:regionArea>
<wicri:noRegion>Universidade do Minho</wicri:noRegion>
</affiliation>
<affiliation wicri:level="1"><country wicri:rule="url">Portugal</country>
</affiliation>
</author>
<author><name sortKey="Simov, Kiril" sort="Simov, Kiril" uniqKey="Simov K" first="Kiril" last="Simov">Kiril Simov</name>
<affiliation wicri:level="3"><country xml:lang="fr">Bulgarie</country>
<wicri:regionArea>IPP, Bulgarian Academy of Sciences, Sofia</wicri:regionArea>
<placeName><settlement type="city">Sofia</settlement>
<region nuts="2">Sofia-ville (oblast)</region>
</placeName>
</affiliation>
<affiliation></affiliation>
</author>
<author><name sortKey="Sutcliffe, Richard" sort="Sutcliffe, Richard" uniqKey="Sutcliffe R" first="Richard" last="Sutcliffe">Richard Sutcliffe</name>
<affiliation wicri:level="4"><country xml:lang="fr">Irlande (pays)</country>
<wicri:regionArea>DLTG, University of Limerick</wicri:regionArea>
<placeName><settlement type="city">Limerick (Irlande)</settlement>
<region type="région" nuts="2">Munster (Irlande)</region>
</placeName>
<orgName type="university">Université de Limerick</orgName>
</affiliation>
<affiliation wicri:level="1"><country wicri:rule="url">Irlande (pays)</country>
</affiliation>
</author>
</analytic>
<monogr></monogr>
<series><title level="s" type="main" xml:lang="en">Lecture Notes in Computer Science</title>
<idno type="ISSN">0302-9743</idno>
<idno type="eISSN">1611-3349</idno>
<idno type="ISSN">0302-9743</idno>
</series>
</biblStruct>
</sourceDesc>
<seriesStmt><idno type="ISSN">0302-9743</idno>
</seriesStmt>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en">Abstract: Following the pilot Question Answering Track at CLEF 2003, a new evaluation exercise for multilingual QA systems took place in 2004. This paper reports on the novelties introduced in the new campaign and on participants’ results. Almost all the cross-language combinations between nine source languages and seven target languages were exploited to set up more than fifty different tasks, both monolingual and bilingual. New types of questions (How- questions and definition questions) were given as input to the participating systems, while just one exact answer per question was allowed as output. The evaluation exercise has highlighted some difficulties in assessing definition questions and can be improved in the future, but the overall analysis of submissions shows encouraging results.</div>
</front>
</TEI>
<affiliations><list><country><li>Allemagne</li>
<li>Bulgarie</li>
<li>Espagne</li>
<li>France</li>
<li>Irlande (pays)</li>
<li>Italie</li>
<li>Pays-Bas</li>
<li>Portugal</li>
</country>
<region><li>Communauté de Madrid</li>
<li>Hollande-Septentrionale</li>
<li>Munster (Irlande)</li>
<li>Sarre (Land)</li>
<li>Sofia-ville (oblast)</li>
<li>Île-de-France</li>
</region>
<settlement><li>Amsterdam</li>
<li>Limerick (Irlande)</li>
<li>Madrid</li>
<li>Paris</li>
<li>Sarrebruck</li>
<li>Sofia</li>
</settlement>
<orgName><li>Université d'Amsterdam</li>
<li>Université de Limerick</li>
</orgName>
</list>
<tree><country name="Italie"><noRegion><name sortKey="Magnini, Bernardo" sort="Magnini, Bernardo" uniqKey="Magnini B" first="Bernardo" last="Magnini">Bernardo Magnini</name>
</noRegion>
<name sortKey="Magnini, Bernardo" sort="Magnini, Bernardo" uniqKey="Magnini B" first="Bernardo" last="Magnini">Bernardo Magnini</name>
<name sortKey="Vallin, Alessandro" sort="Vallin, Alessandro" uniqKey="Vallin A" first="Alessandro" last="Vallin">Alessandro Vallin</name>
<name sortKey="Vallin, Alessandro" sort="Vallin, Alessandro" uniqKey="Vallin A" first="Alessandro" last="Vallin">Alessandro Vallin</name>
</country>
<country name="France"><region name="Île-de-France"><name sortKey="Ayache, Christelle" sort="Ayache, Christelle" uniqKey="Ayache C" first="Christelle" last="Ayache">Christelle Ayache</name>
</region>
<name sortKey="Ayache, Christelle" sort="Ayache, Christelle" uniqKey="Ayache C" first="Christelle" last="Ayache">Christelle Ayache</name>
</country>
<country name="Allemagne"><region name="Sarre (Land)"><name sortKey="Erbach, Gregor" sort="Erbach, Gregor" uniqKey="Erbach G" first="Gregor" last="Erbach">Gregor Erbach</name>
</region>
<name sortKey="Erbach, Gregor" sort="Erbach, Gregor" uniqKey="Erbach G" first="Gregor" last="Erbach">Gregor Erbach</name>
</country>
<country name="Espagne"><region name="Communauté de Madrid"><name sortKey="Pe As, Anselmo" sort="Pe As, Anselmo" uniqKey="Pe As A" first="Anselmo" last="Pe As">Anselmo Pe As</name>
</region>
<name sortKey="Pe As, Anselmo" sort="Pe As, Anselmo" uniqKey="Pe As A" first="Anselmo" last="Pe As">Anselmo Pe As</name>
</country>
<country name="Pays-Bas"><region name="Hollande-Septentrionale"><name sortKey="De Rijke, Maarten" sort="De Rijke, Maarten" uniqKey="De Rijke M" first="Maarten" last="De Rijke">Maarten De Rijke</name>
</region>
<name sortKey="De Rijke, Maarten" sort="De Rijke, Maarten" uniqKey="De Rijke M" first="Maarten" last="De Rijke">Maarten De Rijke</name>
</country>
<country name="Portugal"><noRegion><name sortKey="Rocha, Paulo" sort="Rocha, Paulo" uniqKey="Rocha P" first="Paulo" last="Rocha">Paulo Rocha</name>
</noRegion>
<name sortKey="Rocha, Paulo" sort="Rocha, Paulo" uniqKey="Rocha P" first="Paulo" last="Rocha">Paulo Rocha</name>
</country>
<country name="Bulgarie"><region name="Sofia-ville (oblast)"><name sortKey="Simov, Kiril" sort="Simov, Kiril" uniqKey="Simov K" first="Kiril" last="Simov">Kiril Simov</name>
</region>
</country>
<country name="Irlande (pays)"><region name="Munster (Irlande)"><name sortKey="Sutcliffe, Richard" sort="Sutcliffe, Richard" uniqKey="Sutcliffe R" first="Richard" last="Sutcliffe">Richard Sutcliffe</name>
</region>
<name sortKey="Sutcliffe, Richard" sort="Sutcliffe, Richard" uniqKey="Sutcliffe R" first="Richard" last="Sutcliffe">Richard Sutcliffe</name>
</country>
</tree>
</affiliations>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Wicri/Informatique/explor/SgmlV1/Data/France/Analysis

HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000046 | SxmlIndent | more

HfdSelect -h $EXPLOR_AREA/Data/France/Analysis/biblio.hfd -nk 000046 | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Wicri/Informatique
   |area=    SgmlV1
   |flux=    France
   |étape=   Analysis
   |type=    RBID
   |clé=     ISTEX:3F44C2770B28CC57C00AACF6B8084C8E14D25809
   |texte=   Overview of the CLEF 2004 Multilingual Question Answering Track
}}

This area was generated with Dilib version V0.6.33.
Data generation: Mon Jul 1 14:26:08 2019. Site generation: Wed Apr 28 21:40:44 2021

	Serveur d'exploration sur SGML
	Attention, ce site est en cours de développement ! Attention, site généré par des moyens informatiques à partir de corpus bruts. Les informations ne sont donc pas validées.

Serveur d'exploration sur SGML

Overview of the CLEF 2004 Multilingual Question Answering Track

Overview of the CLEF 2004 Multilingual Question Answering Track

Source :

Abstract

Links toward previous steps (curation, corpus...)

Links to Exploration step

Le document en format XML

Pour manipuler ce document sous Unix (Dilib)

Pour mettre un lien sur cette page dans le réseau Wicri